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DETAILED ACTION 



Response to Amendment 

1. The amendment filed on 18 February 2005 lias been entered in full. 

Response to Arguments 

2. Applicant's arguments regarding the prior art rejections on page 10 of 21 
through 21 of 21 of the Amendment filed on 18 February 2005 have been fully 
considered and are persuasive. Claims 1-30 have been reexamined below. 

Claim Rejections • 35 USC § 112 

3. The following is a quotation of the first paragraph of 35 U.S.C. 1 1 2: 

The specification siiall contain a written description of the invention, and of the manner and 
process of ma!<ing and using it, in such full, clear, concise, and exact terms as to enable any 
person skilled in the art to which it pertains, or with which it is most nearly connected, to make 
and use the same and shall set forth the best mode contemplated by the inventor of carrying 
out his invention. 

4. Claims 1-4, 5-9, 21-25 and 26-30 are rejected under 35 U.S.C. 112, first 
paragraph, as failing to comply with the enablement requirement. The claim(s) 
contains subject matter which was not described in the specification in such a 
way as to enable one skilled in the art to which it pertains, or with which it is most 
nearly connected, to make and/or use the invention. 

With respect to the claims 1, 5, 21 and 26, they recite the use of one or 
both of an edge density and a comparison between an image of a typical 
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object and the image of the object created by the imaging system to 
determine an optimum focus position which means using either A: edge 
density, or, B: a comparison between an image of a typical object and the image 
of the object created by the imaging system, or, A and B combined: both of an 
edge density and a comparison between an image of a typical object and the 
image of the object created by the imaging system are used to determine an 
optimum focus position. The specification does include the use of A: edge 
density (figure 1; page 12, lines 1-6), or, A and B combined: both of an edge 
density and a comparison between an image of a typical object and the image of 
the object created by the imaging system are used to determine an optimum 
focus position (figure 3; page 12, lines 24-32 through page 16, lines 1-18) but 
specification does not appear to include the use of only B: a comparison 
between an image of a typical object and the image of the object created by the 
imaging system to determine an optimum focus position. Therefore, more details 
are required in order to clearly explain the claimed invention. Without these 
additional details, one of ordinary skill in the art would' be burdened by undue 
experimentation and delay in making or using the claimed invention. All other 
claims depending on claims 1, 5, 21 and 26 are subjected to the same rejection 
as per claims 1,5,21 and 26. 
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Claim Rejections • 35 USC § 102 

5. The following is a quotation of the appropriate paragraphs of 35 

U.S.C. 102 that form the basis for the rejections under this section made in this 

Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in 
public use or on sale in this country, more than one year prior to the date of application for patent in 
the United States. 

6. Claims 1-3, 5-6, and 10-12 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Zwirn et a!., U.S. Patent No. 4,789,898. 

Claim 1 recites "a method of automatically focusing an imaging system on 
an object comprising: using one or both of an edge density in an image of an 
object created by the imaging system and a comparison between an image of 
a typical object and the image of the object created by the imaging system to 
determine an optimum focus position". As the claim 1 recites using one 
alternative to determine an optimum focus position, examiner chose only edge 
density to determine an optimum focus position to reject the claim 1. Zwirn 
discloses "the present invention relates to the field of automatic focusing systems 
and more particularly to the field of automatic focusing systems driven by scene 
information" (col. 1, lines 5-10), particularly information relating to the high 
frequency spectral (edge) density of the scene (col. 1 , lines 54-58), where it is 
apparent that a scene could be an object focused by an imaging system. 
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Zwirn further discloses determining an optimum focus position by adjusting the 
focus position towards the focus position where the high frequency content 
increases thereby increasing the sharpness of the focus (optimum focus) (col. 1, 
lines 62-65; col. 2, lines 1-10, lines 41-45, col. 3, lines 50-60; col. 4, lines 35-39). 

Claim 2 recites "the method of claim 1, wherein using an edge density in 
an image of the object comprises: computing the edge density of each image of a 
set of images of the object; and using a focus position corresponding to an image 
of the set having a greatest edge density as the optimum focus position". Zwirn 
further discloses "As the video information gathering device is brought into focus 
the high frequency content of the video signal will increase. By passing the video 
signal through a band pass filter and then processing it in a conditional integrator, 
a control signal is generated whose amplitude contains information relating to the 
degree of focus. The control signal is stored and later compared to a control 
signal derived from a subsequent scanning. Once a significant change in control 
signal levels is detected a drive signal is sent to the focusing device. If after being 
driven the subsequent scene has less high frequency (edge density) content, the 
a drive signal in the opposite polarity or direction is sent to the focusing device. In 
this manner the scene is toggled into focus only when the scene is initially 
defocused" (col. 1, lines 62-68 through col. 2, lines 1-10). It is clear from the 
above disclosure by Zwirn that a control signal which is a measure of edge 
density (high frequency components) of each scan (or image) of the scene (or 
object) at each different focus is computed and then according to the focus or 
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scan position that has the greatest edge density (high frequency components) 
the optimum focus position is determined and thus a set of images (scans) of the 
scene are evaluated using edge density. 

Claim 3 recites "the method of claim 1, wherein using a comparison 
between an image of a typical object and an image of the object comprises 
"applying a difference between a first focus position and a second focus position 
of the imaging system to a third focus position corresponding to the image of the 
object, such that the third focus position is adjusted to the optimum focus 
position, wherein the first focus position corresponds to a reference image of a 
typical object, and wherein the second focus position corresponds to an image of 
the typical object that closely matches the image of the object". As the claim 1 
recites using one alternative to detemiine an optimum focus position, examiner 
chose only edge density to determine an optimum focus position to reject the 
claim 1. Claim 3 is not required to be considered as it depends on the 2"" 
limitation of the claim 1 which was not used for art rejection as per claim 1 . 
However, claim 3 is rejected as to expedite the patent examining. As discussed 
in the rejection of claim 2. the first control signal representing first focus position 
stored in the memory is compared to the second (subsequent) control signal 
representing second (subsequent) focus position, to determine the direction of 
the focusing to obtain optimum (third) focus position. It is clear from the Zwirn's 
disclosure as disclosed in the rejection of claim 2, that first control signal the first 
control signal representing first focus position stored in the memory is taken as 
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the reference image (or scan) signal of the scene (typical object), and the second 
(subsequent) control signal representing second (subsequent) focus position 
corresponds to an image of the scene (typical object) that closely matches the 
image of the object. 

Claim 5 preamble claims to use one or both of the limitations for 
automatically focusing an image of an object, therefore only one limitation is 
considered for the rejection. Claim 5 recites "A method of automatically focusing 
an imaging system on an object comprising one or both of: using a first focus 
position corresponding to an image of the object created by the imaging system 
that has a greatest edge density as an optimum focus position for the imaging 
system". Just considering one limitation of claim 5, the first focus position is read 
as the starting focus position. Claim 5 has been similarly analyzed and rejected 
as per claims 1 and 2. 

Claim 6 has been similarly analyzed and rejected as per claims 5. 1 and 

2. 

Claim 10 has been similarly analyzed and rejected as per claims 1 and 2. 

Claim 11 recites "the method of claim 10, wherein the computed edge 
density is a relative measure of edges in each of the images". As discussed in 
the rejection of claims 1 and 2, Zwirn discloses the computed high frequency 
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spectral (edge) density of the scene (object) is measured by measuring high 
frequency components (edges) in each of the images. Therefore, claim 11 has 
been similarly analyzed and rejected as per claims 10, 1 and 2. 

Claim 12 recites The method of claim 10, wherein the edge density is 
computed using an edge density metric employing one of any gradient-based 
and any non-gradient-based edge detection and image processing methods". As 
discussed in the rejection of claim 2, the video signal is passed through the band 
pass filter 15 to detemiine the degree of focus (edge density). Therefore, claim 
12 has been similarly analyzed and rejected as per claims 10, 1 and 2. 

Claim Rejections - 35 USC § 103 

7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described 
as set forth In section 102 of this title, If the differences between the subject matter sought to 
be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the Invention was made to a person having ordinary skill in the art to which 
said subject matter pertains. Patentability shall not be negatived by the manner In which the 
invention was made. 

8. Claims 4 and 9 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Zwirn et al., U.S. Patent No. 4,789,898. further in view of Applicant's 
admitted prior art in the instant invention. 
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Claim 4 recites "The method of claim 1 , wherein using one or both of an 
edge density and a comparison automatically accounts for warpage in the 
object". As discussed in the rejection of claim land 2, each image or scan has it's 
own focus position and using the edge density the optimum focus position for the 
scene (or object) is determined at that part of the scene. However, it would be 
apparent to the one of ordinary skill in the art that if scene or object is large 
enough to scan or image at one time, different parts of scene or object may be 
brought into focus where each part has different edge density at different focus 
position, and when all different focused parts are looked at all together it would 
appear like a warpage and this is well known in the art too. Applicant's has 
admitted in background of the art that "If the PCB is large, several targets may be 
used at different xy-locations on the board to account for possible warpage of the 
PCB" (specification, page 2, lines 25-26). Therefore, it would have been obvious 
for one of ordinary skill in the art at the time of invention was made to view a 
scene or an object with different focusing targets on the scene or object all 
together as a warpage. 

Claim 6 has been similarly analyzed and rejected as per claim 4. 

9. Claims 21 and 23 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Zwirn et al., U.S. Patent No. 4,789,898, further in view of 
Onoguchi et al.. U.S. Patent No. 6,067,164. 
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Claim 21 recites "An imaging system having automatic focusing 
comprising: an imaging subsystem that images an object; a memory; a computer 
program stored in the memory; and a controller that executes the computer 
program and controls the imaging subsystem, wherein the computer program 
comprises instructions that, when executed by the controller, implement using an 
image of the object created by the imaging system to determine an optimum 
focus position, the determination being one or both of edge-density based and 
image comparison-based". Claim 21 claims to use one or both of the limitations 
for automatically focusing an image of an object, therefore only one limitation is 
considered for the rejection. Zwirn discloses video camera (coL 3, lines 42-45) 
which captures the object or scene image and sends it to the circuit in figure 1 , 
where figure 1 shows the controller which controls the auto-focusing performed 
by video camera and Zwirn as discussed in the rejection of claim 2, also uses 
memory to store the degree of focus (edge density) value which is calculated to 
determine the optimum focus position. Zwirn does teach automatic focusing by 
computing edge density using the circuit in figure 1 but Zwirn does not teach the 
control of automatic focusing using a software stored on a memory but it is very 
well known in the art that any image processing function controlled using only a 
hardware, can also be controlled using software and this is further supported by 
Onoguchi. 

Onoguchi performs auto-focusing on electron microscope for 
semiconductor inspection (col. 3, lines 40-52; col. .20, lines 13-21) and teaches 
high frequency component determination to find the sharp focus position (col. 24, 
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lines 58-68) and further teaches that the auto-focusing can be controlled using a 
computer readable program embedded on a computer readable medium 
(memory) (col. 4. lines 34-41). Therefore, it would have been obvious for one of 
ordinary skill in the art at the time of invention was made to control the auto- 
focusing using a computer program as taught by Onoguchi in the invention of 
Zwirn because both references belong to the same field of automatic focusing of 
an object and Onoguchi an automatic image auto-focusing using software so that 
a work load on the operator can be reduced while the throughput of the process 
can be improved considerably (see Onoguchi: col. 3, lines 50-52). Onoguchi 
further teaches "the present invention may be conveniently implemented using a 
conventional general purpose digital computer programmed according to the 
teachings of the present specification, as will be apparent to those skilled in the 
computer art. Appropriate software coding can readily be prepared by skilled 
programmers based on the teachings of the present disclosure, as will be 
apparent to those skilled in the software art" (col. 28, lines 49-57). 

Claim 23 has been similarly analyzed and rejected as per claims 21, 1 

and 2. 

Claim 26 has been similarly analyzed and rejected as per claims 21, 1 

and 2. 
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Claim 27 has been similarly analyzed and rejected as per claims 26, 21, 1 

and 2. 

10. Claims 25 and 30 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Zwirn et al., U.S. Patent No. 4,789,898, further in view of 
Onoguchi et al., U.S. Patent No. 6,067,164 and further in view of Rooks et al., 
IEEE, June 5, 1999, "Development of an inspection process for ball-grid-array 
technology using scanned-beam x-ray laminography". 

Claim 25 recites "the image system of claim 21 being an x-ray 
laminography system". Zwirn and Onoguchi both does not disclose the image 
system being an x-ray system, but Onoguchi as discussed in the rejection of 
claim 21 discloses semiconductor inspection using automatic focusing of 
microscope and Zwirn as discussed in the rejection of claim 1 teaches "the 
present invention relates to the field of automatic focusing systems and more 
particularly to the field of automatic focusing systems driven by scene 
information" (col. 1, lines 5-10). Rooks teaches that in order to inspect the 
eutectic-solder fillets of BGA joints using an X-ray system, the system must be 
able to focus on a particular horizontal cross-sectional plane and, therefore, 
isolate the solder fillets from the solder balls and Rooks further teaches Scanned- 
beam x-ray laminography (SBXLAM) which is the only automated solder 
inspection system which is capable of focusing on a horizontal plane to examine 
features within the plane with great detail and contrast (page 851, right col., last 
para, through page 852, left col.). Therefore, it would have been obvious for one 



Application/Control Number: 10/027,462 Page 
Art Unit: 2625 

of ordinary skill in the art to use the automatic focusing as taught by combined 
invention of Zwirn and Onoguchi in the X-ray laminography system of Rooks 
because Zwirn teaches "the present invention relates to the field of automatic 
focusing systems and more particularly to the field of automatic focusing systems 
driven by scene information" which is also applicable to Rooks, as Rooks wants 
to isolate the solder fillets from the solder balls (scene information) by using 
system that is able to focus on a particular horizontal cross-sectional plane as 
discussed before, which is scene driven focusing and Onoguchi discloses 
semiconductor inspection which Is also applicable to Rooks. Further Rooks 
teaches automated system, from which it is clear the focus is automatically 
perfomned by system and further support is provided by Rooks on page 860, right 
column, first paragraph. 

Claim 30 has been similarly analyzed and rejected as per claims 26, 25, 1 

and 2, 

Allowable Subject Matter 

1 1 . Claims 1 5-20 are allowed. 

The following is an examiner's statement of reasons of allowance: 
The instant invention relates to a method of determining a change in focus 
position of an imaging system. The invention method comprises comparing the 
image of the second object to the images in the set of images of the first object to 
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find a closest matching image, first object to find a closest matching image, the 
closest matching image from the set having an associated third focus position; 
and determining a change in the second focus position to provide an optimum 
focus position for imaging the second object with the imaging system where the 
object being representative of a class of objects. These features in combination 
with the other elements of the claim 15, are not disclosed or suggested by the 
prior art of record. Claims 16, 17, 18, 19 and 20 are dependent on the allowable 
claim 1 5, and thus they are allowable. 

12. Claims 7 and 8 are objected to as being dependent upon a rejected base 
claim 5 but would be allowable if rewritten in independent form including all of the 
limitations of the base claim and any intervening claims. 

The following is an examiner's statement of reasons of allowance: 
The same reason of allowance applied to claim 15 applies to the claim 7. Claim 8 
is dependent on claim 7, therefore are applied the same reasons of allowance as 
applied to claim 7. 

13. Claim 14 is objected to as being dependent upon a rejected base claim 
10, but would be allowable if rewritten in independent form including all of the 
limitations of the base claim and any intervening claims. 

The following is an examiner's statement of reasons of allowance: 

The same reason of allowance applied to claim 15 applies to the claim 14. 
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14. Claims 22 and 24 are objected to as being dependent upon a rejected 
base claim 21 but would be allowable if rewritten in independent form including 
all of the limitations of the base claim and any inten/ening claims. 

The following is an examiner's statement of reasons of allowance: 
The same reason of allowance applied to claim 15 applies to the claims 22 
and 24. 

15. Claims 28 and 29 are objected to as being dependent upon a rejected 
base claim 26 but would be allowable if rewritten in independent form Including 
all of the limitations of the base claim and any intervening claims. 

The following is an examiner's statement of reasons of allowance: 
The same reason of allowance applied to claim 15 applies to the claims 28 
and 29. 

Any comments considered necessary by applicant must be submitted no 
later than the payment of the issue fee and, to avoid processing delays, should 
preferably accompany the issue fee. Such submissions should be clearly labeled 
"Comments on Statement of Reasons for Allowance." 

Conclusion 

16. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 
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• Albrecht, U.S. Patent No. 3,918,071, discloses a automatic 
focusing system and method whicli uses edge density to find the 
optimum focus position (col. 1, lines 5-25). 

• Hannan, U.S. Patent No. 4,404,594, discloses an imaging system • 
with an enlarged depth of field that uses high frequency 
components to determine the sharpest focus image. 

• Imai, U.S. Patent No. 4,825,065. discloses an apparatus for reading 
image recorded on film and uses autofocusing. 

• Coates, U.S. Patent No. 4,816,919, discloses automatic focusing 
system for an optical system. 

• Fisher, U.S. Patent No. 3,878,323, discloses detecting devices for 
image analysis systems. 

• Florant, U.S. Patent No. 5,534,924, discloses a method and device 
to obtain an element of information on depth in the field seen by 
picture-shooting device. 

Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Manav Seth whose telephone number is 
(571) 272-7456. The examiner can normally be reached on Monday to Friday 
from 8:30 am to 5:00 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's trainer, Joseph Mancuso, can be reached on (571) 272-7695. The fax 



Application/Control Number: 10/027,462 Page 
Art Unit: 2625 

phone number for the organization where this application or proceeding is 
assigned Is 703-872-9306. 



Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status infomriation for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). 
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